Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition

نویسندگان

چکیده

Skeleton data carries valuable motion information and is widely explored in human action recognition. However, not only the but also interaction with environment provides discriminative cues to recognize of persons. In this paper, we propose a joint learning framework for mutually assisted ''interacted object localization'' ''human recognition'' based on skeleton data. The two tasks are serialized together collaborate promote each other, where preliminary type derived from alone helps improve interacted localization, which turn final Besides, explore temporal consistency as constraint better localize absence ground-truth labels. Extensive experiments datasets SYSU-3D, NTU60 RGB+D, Northwestern-UCLA UAV-Human show that our method achieves best or competitive performance state-of-the-art methods Visualization results can provide reasonable localization results.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Leveraging the Path Signature for Skeleton-based Human Action Recognition

Human action recognition in videos is one of the most challenging tasks in computer vision. One important issue is how to design discriminative features for representing spatial context and temporal dynamics. Here, we introduce a path signature feature to encode information from intra-frame and inter-frame contexts. A key step towards leveraging this feature is to construct the proper trajector...

متن کامل

Informative joints based human action recognition using skeleton contexts

The launching of Microsoft Kinect with skeleton tracking technique opens up new potentials for skeleton based human action recognition. However, the 3D human skeletons, generated via skeleton tracking from the depth map sequences, are generally very noisy and unreliable. In this paper, we introduce a robust informative joints based human action recognition method. Inspired by the instinct of th...

متن کامل

Skeleton-Based Human Action Recognition with Profile Hidden Markov Models

Recognizing human actions from image sequences is an active area of research in computer vision. In this paper, a novel HMMbased approach is proposed for human action recognition using 3D positions of body joints. First, actions are segmented into meaningful action units called dynamic instants and intervals by using motion velocities, the direction of motion, and the curvatures of 3D trajector...

متن کامل

Object Recognition based on Local Steering Kernel and SVM

The proposed method is to recognize objects based on application of Local Steering Kernels (LSK) as Descriptors to the image patches. In order to represent the local properties of the images, patch is to be extracted where the variations occur in an image. To find the interest point, Wavelet based Salient Point detector is used. Local Steering Kernel is then applied to the resultant pixels, in ...

متن کامل

Vision Based Object Recognition and Localization

The goal of this project is to be able to match unaligned images corresponding to different viewpoints of the same object or location. An application of this matching localizing a robot based on what it sees and compare it with previously seen images of the world. We do this by improving upon standard PCA matching algorithms. Instead of directly comparing images, we first extract sub-windows us...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Multimedia

سال: 2022

ISSN: ['1520-9210', '1941-0077']

DOI: https://doi.org/10.1109/tmm.2022.3175374